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Abstract — Recent work for single-relay channels shows that 
quantize-forward (QF) with long-message encoding achieves the 
same reliable rates as compress-forward (CF) with short-message 
encoding. It is shown that short-message QF with backward 
or pipelined (sliding-window) decoding also achieves the same 
rates. Similarly, for many relays and sources, short-message QF 
with backward decoding achieves the same rates as long-message 
QF. Several practical advantages of short-message encoding are 
pointed out, e.g., reduced delay and simpler modulation. Fur- 
thermore, short-message encoding lets relays use decode-forward 
(DF) if their channel quality is good, thereby enabling multi- 
input, multi-output (MIMO) gains that are not possible with 
long-message encoding. Finally, one may combine the advantages 
of long- and short-message encoding by hashing a long message 
to short messages. 

I. Introduction 

Relaying is receiving attention for wireless cellular appli- 
cations because it improves rates and reliabilities. There are 
two simple geometric scenarios that give insight into relaying 
strategies, and that show how relaying achieves distributed 
multi-input, multi-output (MIMO) gains First, relays that 
are close to a source node can achieve "multi-input" gains 
by using a decode-forward (DF) strategy. Second, relays that 
are close to a destination node can achieve "multi-output" 
gains by using a compress-forward (CF) strategy. Both the 
DF and CF strategies appeared for abstract channels in the 
work of Cover and El Gamal |2|. This document focuses on 
the CF strategy whose usefulness for network communication 
has been demonstrated., e.g., in Q, 101 and follow-up works. 

Recently, a method called noisy network coding was devel- 
oped [51, pSl that is a quantize-forward (QF) variant of the 
CF strategy. The QF strategy uses simple relays and achieves 
a remarkably simple-to-describe rate region that is sometimes 
close to a cut-set upper bound. Our main goal is to outline 
why the short-message CF method of 17] Sec. V] can achieve 
better rates and reliabilities with less complexity than the 
long-message QF methods of ||5l, 16]. This extends results by 
Wu and Xie 18), 19) who found that short-message encoding 
achieves the same rates as long-message encoding for a single 
source. Finally, we describe a hashing scheme that combines 
some of the advantages of long- and short-message encoding. 

II. Taxonomy 

We first address terminology. Variations of the compression 
strategy of Cover and El Gamal |2| are known by names 
such as "estimate-forward" (EE), "compress-forward" (CF), 
"quantize-forward" (QF), "quantize-map", "hash-forward" 
(HF), and so forth. We make the following observations. 



• The word "compress" is a generic name that refers to 
both lossless and lossy source coding, the latter including 
"quantization" and "hashing" (or "binning"). 

• Without hashing one obtains a QF strategy 14), 15], 0. 

• Without quantization one obtains a HF strategy ifTOl . 

• The name of a relay function should not depend on the 
choice of operations at other nodes. In particular, it should 
not depend on whether other nodes perform optimal or 
suboptimal processing. 

The last bullet point sometimes causes confusion. Some 
literature takes CF to mean that the "next" relay along a route 
must decode certain indices, perhaps even with a suboptimal 
decoder However, if one accepts this bullet point, such ter- 
minology makes little sense. We therefore advocate to use the 
(generic) name CF for the general strategy, HF for a strategy 
without quantization, and QF for a strategy without hashing. 
Of course, this makes HF and QF (and noisy network coding) 
special cases of CF. 

III. Quantization Suffices 

We review the recent QF strategy, see 15], IS- However, 
rather than using long-message repetition encoding we use 
"shorf'-message encoding (see [2. Thm. 6], Q Sec. V], l8], 

0, ATI ) and pipelined decoding via a sliding-window method 
(see Q Sec. LA], E], lEl p. 842], lEi p. 761],). As 
usual, we use independent random codebooks for each block 
(see im p. 842] and QS] p. 760]). We use the notation 

= xi, X2, ■ ■ ■ ,Xn and T"{Px) for e-typical sets. 

Code Construction: Encoding is performed in B + 1 blocks, 
and we generate a different code book for each block (see 
Figure [T] where 5 + 1 = 4). For block 5, 5 = 1, 2, . . . , B + 1, 
generate 2"^ codewords a;"j(ti;), w = 1,2, . . . ,2"^^, by 
choosing the symbols xii,i{w), i — 1,2, . . . ,n, independently 
using Pxi(-)- Similarly, generate 2"^^ codewords X2ii{v), 
V = 1, 2, . . . , 2"^^, by choosing the X2m{v) independently 
using Px2(-)- Finally, introduce an auxiliary random variable 
I2 that represents a quantized version of Y2, and consider 
a distribution Py^\x2^''^' ^'^^ ^^ch X2i,{v), generate 2"^^ 
codewords y2j^(v,u), u — 1, 2, . . . , 2"^^, by choosing the 
y2bi{v,u) independently using -Py2|X2(-k26i(w))- 

Source: The message w of 2"^^ bits is split into B blocks 
wi, W2, ■ ■ ■ , wb of 2"^^ bits each. In block h,b — 1,2, ... , B+ 

1, the source transmits xib{wb), where wb+i = 1- 
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Fig. 1. A quantize-forward strategy for the relay channel. 

Relay. In block b — 1, the relay transmits (1). After block 
b, the relay has seen j/jb- The relay tries to find a ui, such that 

{y^,{vb, u,),x^M,y2b) e Tl\Py^^^y;). (1) 

If one or more such are found, then the relay chooses one of 
them, sets tif,+i = Mb, and transmits X2{b+i){vb+i) ■ If no such 
pair is found, the relay sets Vb+i = 1 and transmits X2(b+i) (!)■ 

Sink Terminal: After block 6, 6 = 2, 3, . . . , B + 1, the receiver 
has seen y^(^f,_^ and j/g^, and tries to find a pair {wb-iTVb) 
such that 

i^2b{^b),i/ib)(^T:\Px,Yj and (2) 

(2^1(b-l) (W'b-l), ^2(b-l)(^6-l' 2;2(b-l) ( Vl), 2/3(b-l)) 

e rr(P^^^.,;,,^3), (3) 

and we assume that iib-i = fb-i- If one or more such 
{■Wb-i,Vb) are found, then the sink chooses one of them, and 
puts out this choice as (wb-i, ^'b)- If no such (wb-i^Vb) is 
found, the sink puts out (wb-i, Vb) ~ (1, 1). 

Analysis: The analysis follows familiar steps, see lfT4l Sec. 
15.2] and we summarize the results. 
1) The relay quantization requires 



R2 > HY2;Y2\X2 



(4) 



2) The sink's decoder can be viewed as a multi-access 
channel (MAC) decoder for two messages Wb-i and Vb 
and therefore we have the bounds 

R < I{Xi;Y2Y3\X2) (5) 
i?2 < IiX2;Y3)+I{Y2;XiY3\X2) (6) 
R + R2< Y3) + I{Y2;XiY3\X2). (7) 

Observe that we cannot ignore the bound (|6|, as might 
be expected, because we require that Vb-i — Vb-i in 
Q. The sums in (|6| and (|7]) are due to the intersection 
of independent events (|2]) and Q. 
The joint distribution of the random variables factors as 

{I\b,c) (8) 

for all a, 6, c, d, /. Performing a Fourier-Motzkin elimination 
of R2, and manipulating the mutual information expressions, 
the bounds (|4]i-(|7| become 

R<I{X^-Y2Y:i\X2) (9) 
R < I{X^X2;Y^) - I{Y2;Y2\X^X2Y^) (10) 
I{Y2;Y2\X^X2Y:i) <I{X2;Y^) (11) 



But suppose that ( fTT) is not satisfied so that ( [T0| and ( [TT| give 

i?</(Xi;r3|X2) (12) 

which is a stronger bound than (|9]l. The rates satisfying ([12]) 
are achievable with QF, e.g., by choosing Y2 independent of 
X2 and Y2 (and thus Xi also). Hence we may ignore the 
constraint ( [TT| . The resulting QF rates are as close as desired 
to the known CF rate 



RcF 



max mm 



/(Xi;y2>3|^2), 

/(X1X2; Fs) - 1-21^1^2 X3) 



(13) 



where the maximization is over all distributions factoring as 
in ([8]). The rate ( [T3| ) is the same as the more commonly used 
expression (see ifTSl Thm. 3 and eq. (6)]) 

i?CF = max /(Xi;y2 1^3 1^2) 

subject to I{Y2;Y2\X2Y^) < /(X2; ^3)- (14) 

IV. Discussion 

Short Messages and Backward Decoding 

One may decode short-message encoded packets by using 
backward decoding (see, e.g., fT), ||9l, lfT6l ) as long as the final 
transmission block is sufficiently long to be able to decode 
vb+1- The bound (|6]l is replaced with the weaker constraint 

i?2 </(^2;i"3l^l)+/(^^2;^li"3l^2) (15) 

which means that ([TTJ is replaced with the weaker constraint 

7(^2; >'2|^i^2 5^3) < /(X2; Fal^i). (16) 

We thus find that backward decoding should outperform 
pipelined decoding for slow-fading channels with outage. 

Another possibility is for the receiver to jointly decode all 
indices after transmission is completed. Yet another possibility 
is to use a pipelined decoder with a longer and variable 
window length, either in the forward or backward directions. 
For example, the window length may be b for block b. 

Advantage of Long Messages: Reliability 

One advantage of long-message encoding is that the quan- 
tization constraint (|6| disappears (which means that ( [TT| ) 
disappears). Thus, long-message encoding should outperform 
short-message encoding for slow-fading channels with outage. 

Advantage of Short Messages: DF and Distributed MIMO 

As mentioned in the introduction, relaying achieves dis- 
tributed MIMO gains if relays close to a source use DF and 
relays far from a source use CF/QF HI, l?). Unfortunately, 
long-message encoding inhibits DF because the message is 
usually too long to decode after receiving one block of channel 
outputs. In contrast, short-message encoding lets relays close 
to a source decode messages early. These relays can form a 
distributed transmit array with this source. 



Advantage of Short Messages: Modulation Complexity 

A subtle advantage of short messages is that one can map a 
small number of bits onto the modulation, i.e., the modulation 
set can be kept small. When using long-message encoding, 
one would either have to use a (very) large modulation set, 
or one must first hash the long message to a shorter message 
(see below). Either way, long-message decoding is complex 
and will suffer implementation and synchronization losses if 
a large modulation alphabet is used. 

Advantage of Short Messages: Encoding and Decoding Delay 

Short-message encoding has a considerably-reduced encod- 
ing delay as compared to long-message encoding. Similarly, 
pipelined decoding enjoys a considerably-reduced decoding 
delay. The combination of these two approaches might support 
streaming applications. 

Alternative: Hashing a Long Message to Short Messages 

We may combine the reliability advantage of long-message 
encoding with the early decoding and modulation complexity 
advantages of short messages by hashing the long message to 
many short messages before transmission. Relays may now de- 
code short hash messages if they can, thereby enabling DF and 
distributed MIMO. Furthermore, the quantization constraints 
such as (|6| disappear like for long-message encoding. The 
price paid is long encoding and decoding delays. 

Multiple Relays, Messages, and Destinations 

As shown in fSl, f9l, short-message encoding and backward 
decoding achieves the same bounds on R as in |5|, |6| for 
multiple relays. This statement is also valid for multiple relays 
and multiple sources. 

Quantizing and Hashing 

The knowledgable reader may wonder why hashing (or 
binning) is not needed to achieve the CF rates, in seeming 
contradiction to results in, e.g., ifTOl and ifTTl . Of course, 
one obvious explanation is that we are using a better (joint) 
decoder rather than a step-by-step decoder 

However, the model of 1 10 1 deserves closer inspection. The 
relay channel in |10| does not have the "standard" form with 
a memoryless channel p{y2,y3\xi,X2)', there is instead a rate 
constraint Rq on the relay-destination link. But we can bring 
such a channel into standard form by introducing a random 
variable X2 that represents the relay's transmit symbols and 
choose its alphabet size \X2 \ as 2^° (if 2^° is not an integer we 
may choose a model with memory on the relay-destinaton link 
and again appropriately limit the size of the input alphabet). 
Now suppose that R2 > Rq in which case QF necessarily 
assigns the same codeword Xjf, to (exponentially in n) many 
indices vi,. In other words, QF implicitly performs hashing. 
The same consideration shows that Wyner-Ziv coding may be 
considered to be using QF only (without a binning step). A 
similar claim can be made for Slepian-Wolf coding. Of course, 
this statement lacks depth since whether we call implicit 
binning QF or HF is not important. 



The reader may now wonder whether QF always performs 
hashing implicitly. We emphasize that this is generally not the 
case when R2 < log | A2 1. For example, for real-input channels 
such as Gaussian channels we have IA2I = 00 and QF will 
generally assign a unique X21, to every index Uf,. 

V. Conclusion 

For the single-relay channel, short-message QF with 
pipelined decoding achieves the same rates as long-message 
QF. For the multi-relay, multi-source channel, short-message 
QF with backward decoding recovers the rates of long- 
message QF. Several advantages of short-message encoding 
are pointed out, e.g., substantial reduction in delay, reduced 
modulation complexity, and added flexibility in letting relays 
choose DF or CF (or QF). 
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